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DETAILED ACTION 
Claim Rejections - 35 USC § 102 

1 . The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form 

the basis for the rejections under this section nnade in this Office action: 
A person shall be entitled to a patent unless - 

(e) the invention was described in a patent granted on an application for patent by another filed in the 
United States before the invention thereof by the applicant for patent, or on an international application 
by another who has fulfilled the requirements of paragraphs (1 ), (2), and (4) of section 371 (c) of this 
title before the invention thereof by the applicant for patent. 

2. Claims 1-3, 5-16, 19-30, 37, 39, 48, 50 are rejected under 35 U.S.C. 102(e) as 
being anticipated by Ho et al. (U.S Patent 6,021,412). (Hereinafter referred to as "Ho") 

As per claim 1, Ho teaches a method for searching a database comprising: 

• "automatically creating a query directly from the indicated object that is 
located within the document, the query including at least a portion of the 
indicated object and having a data structure that is recognizable by a search 
engine for the database" at Col. 1 lines 50-63 and Fig. 8; 

• "providing the query to the search engine, the search engine searching 
the database for at least one object that is related to the Indicated object" at Col. 
1 lines 63-67 and Figs. 9-10; 

• "returning the result from the query of the database, the result indicating 
when at least one object is related to the indicated object" at Col.1 lines 63-67 
and Fig. 10; 

• "producing a display of a related object, so that the related object may be 
associated with the indicated object" at Col. 1 line 67 to Col. 2 line 3 and Fig. 12. 
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As per claim 2, Ho also teaches: "the indicated object and the related 
object include data, the data comprising video, picture, sound, and text" at Col. 3 lines 
1-10. 

As per claim 3, Ho teaches: 

• "enabling a qualification engine to determine a context of the indicated 
object" at Col. 1 lines 50-65; 

• "employing the context of the indicated object to automatically create the 
query for the database" at Col. 1 lines 63-67. 

As per claim 5, Ho teaches "a method for obtaining an image from a 
database for insertion into a document" (Col. 1 lines 35-40) comprising: 

• "enabling an automatic creation of a query directly from the indicated text 
that is located within the document, the query including at least a portion of the 
indicated object and having a data structure that is recognizable by a search 
engine for the database" at Col. 1 lines 50-63; 

• "providing the query to the search engine, the search engine searching 
the database for an image that is related to the indicated text" at Col. 1 lines 63- 
67; 

• "returning the result from the query of the database, the result indicating 
when at least one image is related to the indicated text" at Col. 1 lines 63-67; 

• "enabling the display of at least one image indicated by the result from the 
query, a displayed image being selectable for insertion into the document" at Col. 
1 line 67 to Col. 2 line 5. 
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• "displaying a related image that is inserted into the document, so that the 

related image is associated with the indicated text in the document" at Fig. 12. 

As per claim 6, Ho also teaches: "employing a user interface component 
to automatically create the query for the database, the creation of the query being 
related to the indicated text" at Fig. 2-4 and Figs 7-9. 

As per claim 7, Ho teaches: "the user interface component enables the 
indicated text to be edited" at Col. 3 line 63 to Col. 4 line 2. 

As per claim 8, Ho teaches: "the user interface component enables the 
indicated text to be chosen in the document" at Col. 3 lines 40-50. 

As per claim 9, Ho teaches: "choosing the indicated text in the document 
for the query of the database from within an application program that provides the 
document" at Col. 3 lines 50-55. 

As per claim 10, Ho teaches "choosing a command to create the query 
for the indicated text, the command including an indication in a context menu, drop- 
down menu, pop-up window, dialogue box, toolbar and hot key" at Fig. 4. 

As per claim 11, Ho teaches: "choosing the indicated text in the 
document for the query of the database from an application program that is separate 
from another application program that provides the document" at Col, 4 lines 20-25. 

As per claim 12, Ho teaches: "enabling the indicated text to 
be chosen in another application program that does not provide the document, including 
a clipboard program" at Col. 4 lines 20-25. 

As per claim 13, Ho teaches: 
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• "enabling a qualification engine to determine a context of the indicated text 
within the document" at Col. 1 lines 50-65. 

• "providing the context of the indicated text to the user interface 
component, the user interface component employing the context of the indicated 
text to automatically create the query for the database" at Figs. 6-9. 

As per claim 14, Ho teaches: "the determined context of the indicated 
text includes text, template, sound, video, picture, use and user preference" at Col. 9 
lines 25-30. 

As per claim 15, Ho teaches "the search engine is a local search engine, 
the local search engine employing the query to search for related images on a local 
drive that includes the database" at Col. 4 lines 3-25. 

As per claim 16, Ho teaches: " the local drive includes hard disk, floppy 
disk, tape drive, DVD and CD-ROM" at Col. 4 lines 3-10. 

As per claim 19, Ho teaches: "further comprising employing a result 
component to manage the result of the query returned by the search engine, the result 
component enabling the parsing, storing and display of the result of the query" at Col. 3 
lines 30-35. 

As per claim 20, Ho teaches: "the result is in a metadata format" at Col. 6 

lines 15-20. 

As per claim 21, Ho teaches: "requesting at least one related image from 
the database that is indicated by the result of the query, the related image being 
provided as binary image data" at Col. 3 lines 30-35. 
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As per claim 22, Ho teaches: "employing an image component for 
managing the storage and display of binary image data" at Figs. 10-11. 

As per claim 23, Ho teaches: "employing a navigation component to 
provide at least one control for displaying at least one related image" at Figs. 10-11. 

As per claim 24, Ho teaches: "a navigation component enables the 
display of a group of related images in a slide show, the group of related images being 
indicated in the result from the query" at Figs. 10-11. 

As per claim 25, Ho teaches: "the navigation component enables another 
group of related images to be displayed in the slide show, the other group of related 
images being indicated in the result from the query" at Figs. 10-1 1 . 

As per claim 26, Ho teaches: "the navigation component includes a 
control for determining a period of time that each related image is displayed in the slide 
show. 

As per claim 27, Ho teaches: "the navigation component includes a 
control for indicating the number of the related image in the group that is currently 
displayed in the slide show" at Figs. 10-11. 

As per claim 28, Ho teaches: "the navigation component includes a 
control for indicating each group of related images that are currently displayed in the 
slide show" at Figs. 10-11. 

As per claim 29, Ho teaches: "enabling a help facility to provide an 
explanation of a chosen topic and the help facility being launched in response to an 
input" at Figs. 10-11. 
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As per claim 30, Ho teaches: "the display of at least one related image 
further comprises displaying a thumbnail of the related image" at Figs. 10-1 1 

As per claim 37, Ho teaches: "each time indicated text is employed to 
create the query, automatically saving the indicated text as an entry in a history file; and 
enabling at least one of the entries in the history file to be chosen for the currently 
indicated text" at Figs. 6-9. 

As per claim 39, Ho teaches: "automatically determining a word that is 
closest to a cursor when no indicated text is provided and employing the determined 
word as indicated text" at Col. 7 lines 15-20. 

As per claim 48, Ho teaches "a system for obtaining an image from a 
database for pasting into a document" (Col. 1 lines 35-40) comprising: 

• "a client process for causing functions to be performed, including: enabling an 
automatic creation of a query directly from the indicated text that is located within the 
document, the query including at least a portion of the indicated object and having a 
data structure that is recognizable by a search engine for the database" at Col. 1 
lines 50-67; 

• "providing the query to the search engine, the search engine searching the database 
for an image that is related to the indicated text" at Col. 1 lines 63-67; 

• "enabling a display of at least one related image indicated by the result from the 
query, the display of a related image being selectable for insertion into the 
document" at Col. 3 lines 30-35; 
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• "displaying the related image that is inserted into the document, the related image 
being associated with the indicated text in the document" at Figs. 10-11; 

• "a server process for causing functions to be performed, including: returning the 
result from the query of the database, the result indicating when at least one image 
is related to the indicated text" at Col. 3 lines 25-30; 

• "enabling the search engine to locate at least one image in the database that is 
related to the indicated text" at Col. 3 lines 25-30. 



computer-executable components" comprising: 

• "a component for automatically creating a query directly from indicated text that is 
located within the document, the query including at least a portion of the indicated 
object and having a data structure that is recognizable by a search engine for a 
database" at Col. 1 lines 50-67; 

• "a component for providing the query to the search engine, the search engine 
searching the database for an image that is related to the indicated text" at Col. 1 
lines 63-67; 

• "a component for returning the result from the query of the database, the result 
indicating when at least one image is related to the indicated text" at Col. 1 lines 63- 
67; 

• "a component for enabling the display of at least one related image indicated by the 
result from the query, the display of the related image being selectable for insertion 
into the document" at Col. 3 lines 30-35; 



As per claim 50, Ho teaches "a computer readable medium having 
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• "a component for displaying the related image that is inserted into the document, so 
that the related image is associated with the indicated text in the document" at Fig. 



3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, rf the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

4. Claims 4, 18, 31-36, 38, 40-47, 49, 51-53 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Ho (U.S Patent 6,021,412) as applied to claims above, and in 
view of Balogh et al. (U.S Patent 5,493,677). 

As per claim 4, Ho teaches the same as stated in claim 1 argument. Ho does 
not teach "indicating the related object is to be purchased over a network; and providing 
financial information to an electronic commerce service over the network, the electronic 
commerce service enabling the purchase of the related object when the financial 
information is complete". 

However, Balogh teaches the steps of: "indicating the related object is to be 
purchased over a network; and providing financial information to an electronic 
commerce service over the network, the electronic commerce service enabling the 
purchase of the related object when the financial information is complete" at Col, 17 
lines 25-65. Thus, it would have been obvious to one ordinarily skilled in the art at the 
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time of the invention to combine Ho's database searching method with Balogh's 
purchasing step so that "the user may order and obtain delivery of selected images 
directly over a computer connection" (Balogh, Col. 2 lines 5-7). 

As per claim 18, Ho teaches the same as stated in claim 5 argument. Balogh's 
teaches the step of "employing a network component to communicate with the search 
engine over a network, the network including an intranet and the Internet" at Fig. 1 1 . 

As per claim 31, Ho teaches the same as stated in claim 5 arguments. Balogh's 
teaches the step of "including a digital watermark with the related image, the digital 
watermark including information related to the content of the related image" at Fig. 5. 

As per claim 32, Ho teaches the same as stated in claim 5 arguments. Balogh 
teaches: "including a cookie with the query, the cookie including information related to a 
user" at Col. 9 lines 15-35. 

As per claim 33, Ho teaches the same as stated in claim 5 argument. Ho also 
teaches the step of "inserting a higher quality image into the document so that the 
higher quality image is displayed with the indicated text" at Fig. 12. Balogh teaches the 
step of "indicating a higher quality image of the related image is to be purchased over a 
network; and providing financial information to an electronic commerce service over the 
network, the electronic commerce service enabling the purchase of the higher quality 
image when the financial information is complete" at Col. 17 lines 25-65. 

As per claim 34, Ho teaches the same as stated in claim 5 argument. Balogh 
teaches "employing an electronic shopping cart to store a potential purchase of the 
higher quality image" at Col. 17 lines 25-40. 
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As per claim 35. Ho teaches the same as stated in claim 5 argument. Balogh 
teaches: "enabling a parameter of the higher quality image to be indicated" at Col. 17 
lines 28-38. 

As per claim 36, Ho teaches the same as stated in claim 5 argument. Balogh 
teaches: "enabling a use of the higher quality image to be indicated" at Col. 17 lines 50- 
55. 

As per claim 38, Ho teaches the same as stated in claim 5 argument. Balogh 
teaches: "embedding a URL with the related image pasted into the document, the URL 
providing a link to information associated with the related image" at Col. 17 lines 2-12. 

As per claim 40, Ho teaches the same as stated in claim 18 argument. Balogh 
teaches: " the network component employs a transmission device to automatically 
connect to the search engine for the database, the transmission device including cable 
modem, network interface card, telephony modem, satellite dish and radio transceiver" 
at Col. 16 lines 20-40. 

As per claim 41, Ho teaches the same as stated in claim 18 argument. Balogh 
teaches the step of "employing the network component to automatically connect to the 
search engine for the database when the search engine is remotely located from the 
indicated text" at Col. 16 lines 20-40. 

As per claim 42, Ho teaches the same as stated in claim 18 argument. Balogh 
teaches: "the network component employs a proxy server to automatically connect to 
the search engine for the database" at Fig. 1 1 . 
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As per claim 43. Ho teaches the same as stated in claim 18 argument, Balogh 
teaches: "the network component employs a dial up facility to automatically connect to 
the search engine for the database" at Col. 16 lines 25-40. 

As per claim 44, Ho teaches the same as stated in claim 18 argument. Balogh 
teaches: "the network component launches a browser to automatically connect to the 
search engine for the database" at Col. 16 lines 40-50. 

As per claim 45, Ho teaches the same as stated in claim 18 argument. Balogh 
teaches: "the network component automatically connects to the search engine" at Col. 
16 lines 20-40. 

As per claim 46, Ho teaches the same as stated in claim 18 argument. Balogh 
teaches: "the network component launches a browser to manage a purchase of a higher 
quality image associated with the related images" at Col. 17 lines 39-65. 

As per claim 47, Ho teaches the same as stated in claim 18 argument. Balogh 
teaches: "the network component manages a purchase of a higher quality image 
associated with the related image" at Col. 17 lines 39-65. 

As per claim 49, Ho teaches the same as stated in claim 48 arguments. Ho also 
teaches the step of "inserting the higher quality image into the document so that the 
higher quality images is displayed with the indicated text" at Fig, 12. 

Ho does not teach "indicating a higher quality image of the related image is to be 
purchased over a network; and providing financial information to an electronic 
commerce service over the network, the electronic commerce service enabling the 
purchase of the higher quality image when the financial information is complete". 
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However, Balogh teaches the steps of: "indicating a higher quality image of the 
related image is to be purchased over a network; and providing financial information to 
an electronic commerce service over the network, the electronic commerce service 
enabling the purchase of the higher quality image when the financial information is 
complete" at Col. 17 lines 25-65. 

Thus, it would have been obvious to one ordinarily skilled in the art at the time of 
the invention to combine Ho's image database searching method with Balogh's 
purchasing step so that "the user may order and obtain delivery of selected images 
directly over a computer connection" (Balogh, Col. 2 lines 5-7). 

As per claim 51, Ho teaches a method for searching an image database 

comprising: 

• "automatically creating a query related to an indicated object, the query having a 
data structure that is recognizable by a search engine for the database" at Col. 1 
lines 50-63; 

• "providing the query to the search engine, the search engine searching the database 
for at least one image that is related to the indicated object" at Col. 1 lines 63-67; 

• "returning the result from the query of the database, the result indicating when at 
least one image is related to the indicated object" at Col. 1 lines 63-67; 

• "enabling a display of the related image, so that the related image may be 
associated with the indicated object" at Col. 1 line 67 to Col. 2 line 3. 

Ho does not teach the step of: "indicating a related image is to be 
purchased over the network, financial information being provided to an electronic 
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commerce service that enables the purchase of the related image when the financial 

information is complete". 

However, Balogh teaches the steps of: "indicating the related image Is to 
be purchased over a network; and providing financial information to an electronic 
commerce service that enables the purchase of the related image when the financial 
information is complete" at Col. 17 lines 25-65. Thus, it would have been obvious to one 
ordinarily skilled in the art at the time of the invention to combine Ho's database 
searching method with Balogh's purchasing step so that "the user may order and obtain 
delivery of selected images directly over a computer connection" (Balogh, Col. 2 lines 5- 
7). 

As per claim 52, Ho also teaches: "the indicated object includes data, 
comprising video, picture, sound, and text" at Col. 9 lines 25-30. 

As per claim 53, Ho also teaches the following steps: 

• "enabling a qualification engine to determine a context of the indicated object" at Col. 
1 lines 50-65; and 

• "employing the context of the indicated object to automatically create the query for 
the database" at Col. 1 lines 63-67. 

7. Claim 17 is rejected under 35 U.S.C. 1 03(a) as being unpatentable over Ho 
(U.S Patent 6,021 ,412) as applied to claim 5 above, and in view of Baru et al ("XML 
Based information Mediation for Digital Libraries.") 

As per claim 17, Ho teaches the same as stated in claim 5 argument. Ho does 
not teach "the query's data structure include XML". However, Baru teaches: "the query's 
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data structure include XML" at page 214, Col. 1 . Thus, it would have been obvious to 
one ordinarily skilled in the art at the tinne of the invention to implement He's invention 
using XML in order to provide a user-friendly query formulation and optimization. 



Response to Arguments 

6. Applicant's arguments filed December 6, 2002 have been fully considered but 
they are not persuasive. Examiner respectfully traverses applicant's arguments. 

Applicant stated that Ho (U.S 6,021 ,412) does not teach: "automatically creating 
a query directly from the indicated object that is located within the document, the query 
including at least a portion of the indicated object and having a data structure that is 
recognizable by a search engine for the database". On the contrary, as stated in the 
previous Office Action dated 9/6/2002, Ho discloses the step of prompting user to select 
a word which appear in the document ("leadership" or "surprise") in Fig. 8, after user 
select the word "leadership" (i.e., "indicated object") and click the "View Clip Art" button 
(Fig.9), the result of the query using keyword "leadership" is shown in Fig. 10. 
Therefore, Figs. 8-10 of the Ho's reference correspond to steps (a) - (c) of claims 1 , 5. 

Applicant argued that Ho does not disclose "selecting a word that appears in the 
document", the Examiner respectfully disagrees. In Fig. 8, users are allowed to choose 
from two words: "leadership" which appears in slide 1 and "surprise" in slide 2 (see 
Figs. 2 and 3). 

Ho discloses several embodiments of the invention, in the first embodiment, Ho 
teaches: "The facility preferably displays a list of words occurring anywhere in the 



Application/Control Number: 09/376,748 Page 16 

Art Unit: 2177 

presentation document that match one of the concept matching words and allows the 
user to select one of the listed words to add an Instance of graphics to the 
document illustrating the concept referred to by the selected word" (Col. 3 lines 44-49). 
Therefore, in this embodiment, the query is created directly form the indicated text that 
is located within the document, as shown in Figs 8-10. 

In response to applicant's argument that there is no suggestion to combine the 
references, the Examiner recognizes that obviousness can only be established by 
combining or modifying the teachings of the prior art to produce the claimed invention 
where there is some teaching, suggestion, or motivation to do so found either in the 
references themselves or in the knowledge generally available to one of ordinary skill in 
the art. See In re Fine, 837 F.2d 1071, 5 USPQ2d 1596 (Fed. Cir. 1988) and In re 
Jones, 958 F.2d 347, 21 USPQ2d 1941 (Fed. Cir. 1992). As stated in the previous 
Office Action dated 9/6/2002, the difference between Ho and the invention of claims 4, 
51 is that Ho does not disclose the step of allowing users to purchase images over the 
network as claimed. However, buying and selling digital objects over the network are 
well known in the art, as exemplified by Balogh. As noted by Balogh, it is desirable that 
"the user may order and obtain delivery of selected images directly over a computer 
connection" (Col. 2 lines 5-7). Consequently, it would have been obvious to those of 
ordinary skill in the art at the time of the invention to modify Ho's reference to add the 
purchasing step as claimed, financial gain is of course an obvious reasonable 
expectation of success. 
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The proposed combination of the references does not change the principle of 
operation of the references because both Ho and Balogh deal with searching and 
retrieving digital image from an image database using keyword and displaying the 
search result to user. Balogh also allows user to purchase the image in the search 
results before it can be used. Adding the step of purchasing the image to Ho's invention 
is obvious because buying and selling digital objects over the network are well known in 
the art, as exemplified by Balogh. 

In light of the foregoing arguments, the 35 U.S.C 102 and 103 rejections are 
hereby sustained. 

Conclusion 

7. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .1 36(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Khanh B. Pham whose telephone number is (703) 308- 
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7299. The examiner can normally be reached on Monday through Friday 7:30am to 
4:00pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, John E Breene can be reached on (703) 305-9790. The fax phone numbers 
for the organization where this application or proceeding is assigned are (703) 746-7239 
for regular communications and (703) 746-7238 for After Final communications. 

Any inquiry of a general nature or relating to the status of this application or 
proceeding should be directed to the receptionist whose telephone number is (703)746- 
7240. 

Khanh B. Pham 
Examiner 
Art Unit 2177 

KBP 

January 16, 2003 



